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FEASIBLE  OBJECTIVE  CONFIDENCE  BOUNDS 
FOR  SYSTEM  RELIABILITY 

by 

M.  Vernon  Johns,  Jr. 

ABSTRACT 

The  basic  problem  of  determining  objective  (frequentistic) 
confidence  bounds  for  the  reliability  of  a  series  system  based  on 
failure  data  from  tests  of  the  independent  components  is  addressed. 
The  notion  of  confidence  bounds  based  on  orderings  imposed  on  the 
sample  space  is  exploited,  and  certain  optimality  considerations  are 
incorporated.  Advantage  is  taken  of  the  simplifications  resulting 
from  the  use  of  the  Poisson  approximation  for  data  from  highly 
reliable  components.  Tables  of  exact  confidence  bounds  are  produced 
for  the  case  of  two-component  systems.  These  bounds  are  computed 
using  sample  orderings  generated  sequentially  by  a  two-stage,  pro¬ 
spective  optimization  procedure.  A  generalization  of  the  Lindstrom- 
Madden  technique  is  proposed  for  using  the  tables  to  find  confidence 
bounds  for  systems  consisting  of  more  than  two  components  with 
differing  sample  sizes. 

Key  Words:  Reliability,  series-system,  confidence  bounds,  Poisson 
approximation,  Lindstrom-Madden,  sample  orderings. 
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FEASIBLE  OBJECTIVE  CONFIDENCE  BOUNDS 
FOR  SYSTEM  RELIABILITY 

By 

M.  Vernon  Johns,  Jr. 

1.  Introduction 

Certainly  one  of  the  most  basic  statistical  problems  in  the 
assessment  of  system  reliability  is  that  of  determining  a  confidence 
bound  on  the  reliability  of  a  series  system  based  on  component  fail¬ 
ure  data.  The  continuing  appearance  of  papers  concerned  with  this 
subject  (e.g.,  Harris  and  Soms  1981,  Butcher  et  al.  1978,  and 
Winterbottom  1980)  testifies  to  the  elusiveness  of  solutions  which 
are  both  practically  feasible  and  acceptably  precise.  The  present 
paper  deals  with  the  case  of  systems  characterized  by  high  intrinsic 
reliability  (>90%)  where  the  use  of  the  Poisson  approximation  for  the 
binomial  distributions  of  component  failure  data  does  not  introduce 
appreciable  error.  The  emphasis  is  on  objective,  frequentistic  con¬ 
fidence  bounds  which  avoid  the  uncertainties  of  interpretation  asso¬ 
ciated  with  posterior  bounds  obtained  by  Bayesian  methods.  The  use 
of  the  Poisson  distribution  provides  several  advantages.  It  easily 
leads  to  valid  results  for  cases  involving  zero  observed  failures  for 
some  components  where  maximum  likelihood  methods  and  other  proposed 
approximations  tend  to  break  down  (see,  e.g.,  Madansky  1965  and  Mann 
et  al.  1974).  It  also  permits  the  pooling  of  failure  data  for  dif¬ 
ferent  components  having  the  same  test  sample  sizes.  This  potential 
reduction  in  the  effective  number  of  system  components  enhances  the 
utility  of  tabulated  bounds  such  as  those  presented  here. 
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Because  of  the  structure  of  the  problem,  universally  optimal 
confidence  bounds  for  system  reliability  (i.e.,  "uniformly  most 
accurate"  bounds  in  the  sense  of  Lehmann  1959)  do  not  generally  exist 
On  the  other  hand,  the  ideas  of  Buehler  (1957)  may  be  exploited  to 
produce  a  variety  of  valid  confidence  bounds  based  on  total  orderings 
of  the  sample  points.  Such  bounds  are  exact  in  the  sense  that  the 
desired  coverage  probability  is  guaranteed.  The  construction  of  good 
confidence  bounds  is  thus  reduced  to  the  selection  of  suitable  order¬ 
ings  imposed  on  the  sample  space.  This  is  the  approach  adopted  in 
the  present  study.  Previous  applications  of  these  methods  to  relia¬ 
bility  may  be  found,  for  example,  in  Harris  and  Soms  (1980),  Johnson 
(1969) ,  and  Lipow  and  Riley  (1959) . 

Once  the  sample  ordering  approach  has  been  chosen,  there 
remains  the  problem  of  determining  orderings  which  lead  to  confidence 
bounds  which  are  "good"  according  to  some  criterion  measuring  the 
size  (length)  of  the  confidence  region.  An  early  proposal  of  the 
present  author  (Johns  1975)  was  to  generate  the  ordering  by  means  of 
a  simple  function  of  the  observations  which  was  asymptotically  equiv¬ 
alent  to  the  maximum  likelihood  confidence  bound.  This  method  guar¬ 
antees  asymptotic  bptimality  when  the  numbers  of  component  failures 
observed  under  testing  is  large.  It  was  found,  however,  that  the 
resulting  bounds  could  be  noticeably  improved  for  small  to  moderate 
numbers  of  observed  failures  by  more  sophisticated  methods.  Another 
procedure  investigated  (Johns  1977)  was  a  sequential  method  for  gen- 

A 

eratlng  the  sample  ordering  starting  at  the  origin  (zero  component 
failures  observed)  and  selecting  at  each  stage  as  the  next  sample 
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point  the  "adjacent"  point  producing  the  largest  value  for  the  lower 
bound  on  reliability.  This  method,  while  intuitively  appealing,  does 
not  generally  produce  a  "best"  ordering  as  has  been  suggested  by  some 
investigators.  In  particular,  it  is  improved  upon  by  the  method 
adopted  in  the  present  paper. 

The  non-existence  of  a  unique  optimal  ordering  leaves  open 
the  possibility  of  obtaining  a  confidence  bound  which  is  at  least 
admissible  by  choosing  the  sample  ordering  to  minimize  the  expected 
length  of  the  confidence  interval  under  some  suitable  prior 
distribution.  Such  a  semi-Bayes ian  approach  does  not  in  any  way 
impair  the  frequentistic  interpretation  of  the  confidence  bounds 
obtained  from  the  minimizing  ordering.  The  implementation  of  such  a 
minimization,  while  theoretically  perfectly  possible,  turns  out  to  be 
totally  unfeasible  computationally  except  for  the  earliest  part  of 
the  ordering  generated.  Nevertheless,  for  a  class  of  priors  chosen 
to  emulate  certain  properties  of  maximum  likelihood,  fragmentary 
orderings  computed  by  this  method  provide  a  considerable  justifica¬ 
tion  for  the  two-stage  "look-ahead"  sequential  method  actually  used  to 
generate  the  tables  which  are  a  principal  concern  of  this  paper. 

Suppose  that  the  series  system  under  consideration  consists 
of  k  independent  components  and  that  the  respective  probabilities  of 
component  failure  are  p±  =  1  -  q^  i  =  l,2,...,k.  The  system  relia¬ 
bility  R  is  given  by 

k  k 

R=  n  q  -  H  (1-p)  .  (1.1) 

i=l  1  i=l  1 
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If  the  observed  numbers  of  failures  for  the  k  components  are 

based  on  independent  tests  with  corresponding  sample 
sizes  n^,^,  . .  ,,nk,  we  let  X^  =  n^p^  i  =  l,2,...,k,  so  that 


R  -  II  (1-  X./n  )  =  1  -  E  X./n. 
i=l  1  i=l  1  1 


(1.2) 


The  approximation  on  the  right  will  be  best  when  the  p^'s  (=  X^n^) 
are  all  small  which  is  just  the  case  where  R  is  close  to  one  and  the 
Poisson  approximation  for  the  distributions  of  the  X^'s  is  valid. 

It  will  be  convenient  to  express  the  problem  in  a  canonical 
form  by  introducing  some  further  notation.  Let  c  =  1/n^  and 

“  1/cn^,  i  =  l,2,...,k.  Then  letting  X  =  (X^,X2,  . . .  ,Xk)  and 

k 

0(X)  =  E  a  X  ,  (1.3) 

i=l  1  1 


we  have 


k 

R  =  1  -  c  E  a  X,  =  1  -  c0(X)  .  (1.4) 

i=l  1  1 

We  shall  assume  henceforth  that  the  components  are  indexed  so  that 
. . .  _>  which  implies  that  —  a2  —  •  •  •  <  a,  .  The  pro¬ 
blem  of  finding  a  lower  confidence  bound  for  R  is  thus  reduced  to 
that  of  finding  an  upper  confidence  bound  for  0(X).  The  fact  that 
0 (X)  is  a  convex  combination  of  the  X^s  facilitates  tabulation  of 
the  bounds  by  reducing  the  number  of  classification  variables  by  one. 
In  principle,  confidence  bounds  for  R  could  be  constructed  directly 
without  introducing  the  approximation  (1.2)  .  Such  an  approach  would. 
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however,  eliminate  the  possibility  of  constructing  useful  tables  of 
bounds,  since  separate  entries  would  be  required  for  every  configura¬ 
tion  of  (n^n^  . .  .,1^)  . 

The  vector  of  observations  is  X  =  (X^X^  . . .  ,Xfc)  so  that  the 
sample  space  on  which  a  total  ordering  must  be  imposed  consists  of 
all  vectors  x  =  (x^x^  . . .  ,xfc)  where  the  x^s  are  non-negative 
integers.  It  seems  reasonable  to  confine  attention  to  orderings 
which  are  consistent  with  the  natural  partial  ordering  induced  by 
dominence  (see  Section  2),  and  we  shall  do  so.  In  Section  2  it  is 
shown  that  the  best  upper  confidence  bound  for  0 (X)  with  confidence 
coefficient  1  -  a  which  is  monotone  in  a  prescribed  total  ordering 
(designated  by  the  relation  ^ )  is  given  by 

t (x)  =  sup  0(X)  ,  (1.5) 

AesJ(x) 

where  S*(x)  =  {A  :  P.  {X  x}  =  a)  .  From  (1.4)  the  lower  confidence 

CX  A 

bound  for  system  reliability  is  then  given  by 

r(x)  =  1  -  ct(x)  .  (1.6) 
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Because  of  the  additive  property  of  independent  Poisson 

observations  the  effective  number  of  components  in  the  system 

may  be  reduced  if  some  sample  sizes  are  equal  (or  nearly  equal)  as 

follows:  Suppose  n^  »  =  . • .  «  n^  =  n  for  some  r,  2  <  r  <  k.  Then 

a1  =  a„  =  ...  =  a  =  a*  (say)  and  letting  X*  =  -  X.  we  have 

x  z  r  i 

k 

0(A)  =  a*X*  +  Z  a  X.  .  (1.7) 

i=r+l  1  1 


^  r  ^ 

Now  X  =  has  a  Poisson  distribution  with  parameter  X  so  that 

the  right  hand  side  of  (1*7)  has  the  correct  form  for  the  case  of 
dimension  k*  =  k-r+1  except  that  the  coefficients  must  each  be 
divided  by  c^  =  a  +  ar+i  +  •••  +  a^  to  preserve  convexity.  The  con¬ 
fidence  bound  for  the  k*  dimentional  case  based  on  X*,Xr+1> . . . ,X^  and 
the  normalized  coefficients  may  then  be  multipled  by  c^  to  obtain  the 
bound  for  the  original  0(X)  given  by  (1.7)  .  Further  reductions  may 
be  made  in  the  same  way  if  several  groups  of  components  have  common 
sample  sizes.  If  n*L’n2>  *  •  #»nr  are  only  approximately  equal,  their 
average  may  be  used  for  n  in  the  above  calculations  to  obtain  an 
approximate  bound. 

If  all  components  are  subjected  to  the  same  number  of  trials, 
we  may  take  k  equal  to  one  and  the  problem  reduces  to  the  familiar 
one  of  finding  an  upper  confidence  bound  for  a  single  Poisson 
parameter . 

The  component  failure  data  may  be  developed  through  independ¬ 
ent  testing  of  the  components,  or  through  testing  of  the  complete 
system  with  the  assignment  of  failures  to  the  appropriate  components. 
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Even  in  the  latter  case  component  sample  sizes  may  differ  if  com¬ 
ponents  are  redesigned  during  the  course  of  testing  so  that  the 
trials  and  failures  observed  prior  to  redesign  are  not  relevant  to 
the  reliability  of  the  final  version  of  the  system. 

It  is  worth  noting  that  the  same  formal  confidence  bound 
problem  arises  from  a  somewhat  different  and  more  restrictive  model 
involving  continuous  time  sampling  and  exponentially  distributed 
failure  times.  Thus,  if  we  assume  that  the  time  to  failure  of  the 
i-th  component  has  the  exponential  probability  density  function 

-V 

VU  e  ,  >  0,  t  >  0,  and  if  the  fixed  aggregate  testing  time  for 

the  i-th  component  is  given  by  and  the  total  number  of  failures 

observed  is  X. ,  i  = 1, 2, . . . ,k,  then  the  X.  fs  which  are  sufficient  sta- 
i  x 

tistics  have  independent  Poisson  distributions  with  corresponding 
parameters  =  y .  Such  test  data  would  be  generated,  for 
example,  if  a  single  unit  of  each  component  were  placed  on  test  and 
repaired  whenever  a  failure  occurred  until  the  total  test  time  for 
each  component  reached  its  corresponding  limit,  The  system  reli¬ 

ability  for  a  single  duty  cycle  (consisting  of  operation  for  a  unit 
interval  of  time)  is  given  by 

k  -u.  r  '  k  1  k 

R  =  II  e  1  =  exp  -  II  y.  =  exp-l -  2  X./t  .  }•  ,  (1.8) 

i»l  k  i=l  1  i-1  1  1  - 

r  \ 
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and  the  confidence  bound  problem  is  essentially  the  same  as  the  one 
previously  introduced  except  that  no  approximations  are  required. 

The  general  theory  of  confidence  bounds  based  on  sample 
orderings  is  discussed  in  Section  2.  In  Section  3  the  case  of  sys¬ 
tems  having  two  components  is  considered  in  detail,  and  the  rational 
for,  and  use  of,  the  tables  for  this  case  are  explained.  Section  4 
includes  suggestions  for  constructing  approximate  confidence  bounds 
for  cases  of  systems  with  k  _>  3  by  finding  approximately  equivalent 
cases  with  k  =  2.  Use  of  the  maximum  likelihood  ratio  bounds  for 
cases  where  the  data  are  beyond  the  limits  of  the  available  tables  is 
also  discussed . 

2.  Bounds  and  Orderings;  Generalities 

The  idea  of  using  sample  orderings  to  generate  confidence 
bounds  was  first  introduced  by  Buehler  (1957)  who  discussed  the 
validity  of  the  proposed  method  in  the  context  of  a  specific  relia¬ 
bility  problem.  Bol'shev  and  Loginov  (1969)  discuss  the  construction 
of  confidence  bounds  monotone  in  the  sample  orderings  generated  by 
certain  functions  of  the  observations.  In  the  following,  which  is  a 
revision  and  extension  of  Johns  (1975) ,  we  develop  the  theory  with 
emphasis  on  the  sample  orderings  themselves  rather  than  possible 
generators  of  the  orderings. 
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To  develop  the  general  ideas  relating  exact  confidence  bounds 
to  sample  orderings  it  is  convenient  to  introduce  a  fairly  abstract 
statistical  model.  Let  the  sample  space  X  be  endowed  with  a  measura¬ 
ble  total  ordering  relation  "  "  and  let  X  represent  the  random  out¬ 

come  of  the  experiment  where  the  space  of  possible  outcomes  is  X* 
Suppose  that  the  possible  distributions  of  X  are  determined  by  the 
family  of  probability  measures  P^,  indexed  by  A,  an  element  of  the 
parameter  space  A.  Our  objective  is  to  find  a  1  -  a  level  upper  con¬ 
fidence  bound  for  a  specified  real-valued  function  0 (X)  defined  on  A 
w^ere  the  range  T  of  0(A)  is  assumed  to  be  closed  and  bounded  below. 
The  quantity  ae  (0,1)  is  regarded  as  fixed  throughout.  We  make  the 
following  definitions  and  assumptions: 

Definition  Dl.  For  each  x  e  X  let 

S(jt(x)  =  (A  :  P^(X^.  x}  >  a}  .  (2.1) 

Definition  D2 .  For  each  xeX  let 

sup{0(A)  :  AeS  (x)}  ,  if  S  (x)  is  non-empty  , 
t(x)  -  ■  “  01  (2.2) 

inf  T,  otherwise 

Remark  1.  By  D2  if  6(A)  >  t(x),  then  necessarily  P^{x^,  x}  _<  a. 

Assumption  Al.  For  every  subset  C  of  X  having  the  property  that  if 

x  e  C  and  y  ^  x  then  y  £  C,  there  exists  an  ordered  sequence 

x.  ^  x  . . .  of  elements  of  C  such  that  C  =  U°°  i  (x  :  x^  x  }  . 

±  £  n=l  "  n 

Assumption  A2.  For  each  x  £X,  if  0(A)  =  t(x),  then  P^{x<j.x}  £  a. 


9 


Remark  2.  By  Dl,  D2,  and  A2  if  0(X)  =  t(x),  then  X  t  S„,(x)>  i.e., 

Uw 

the  supremum  in  D2  is  never  attained* 

We  now  establish  the  following  propositions. 

Proposition  Pi.  The  function  t(x)  is  monotone  in  the  ordering  on  X* 

Proof :  If  x,yeX  and  x^  y,  then  S^(x)  cz  S^(y)  (Dl)  which  in  turn 
implies  t(x)  t(y)  (D2)  .  jj 

Proposition  P2.  Under  assumptions  A1  and  A2  the  function  t(x)  is  an 
upper  confidence  bound  for  9(A)  at  level  1  -  a.  In  particular, 

Px(0(A)  <  t(X)l  >1  -a  for  all  A  e  A  .  (2.3) 

Proof:  For  arbitrary  Aq  8 A,  let  9^  =  0(A^)  and  Cq  =  {x  :  t(x)<£0g}. 

The  result  follows  immediately  for  all  A^  for  which  Cq  is  empty. 

Assume  that  Cq  is  non-empty.  Then  by  PI  the  set  Cq  possesses  the 

property  required  in  A1  for  the  existence  of  a  sequence  {x^}  c:  Cq 

such  that  x  ^  x  for  all  n,  and  Cr  =  IJ  -  ix  :  x^(  x  }.  This 
n^  n+1  *  0  n=l  ^  n 

implies  that,  as  n  ->■  00 , 

P,  {x<  X  }  t  P ,  {Xe  cn}  .  (2.4) 

X0  ^  n  XQ  0 

But  by  Remark  1  and  A2,  for  all  n,  P^  (x^,  x^}  <  a.  Hence 
P^  {Xe  Cq}  <_  a  and  the  desired  result  follows.  Q 
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Proposition  P3.  Under  assumptions  A1  and  A2,  if  t(x)  is  any  T-valued 
confidence  bound  such  that  P^{0(A)  <  t(X)}  _>  1  -  a  for  all  X e A,  then 

(i)  sup  t(y)  t(x)  for  all  x  eX  ,  and 
y 

(ii)  if  t(x)  is  monotone  in  the  ordering  on  X,  then 
t(x)  t(x)  for  all  xeX  . 

Proof :  First  we  assume  that  t(x)  is  monotone  and  establish  (ii). 

Suppose  there  exists  an  x'  eX  such  that  t(x')  <  t(x’) .  Then  S  (x') 

a 

must  be  non-empty  and  by  Remark  2  following  A2,  the  sup  defining 

t(x')  is  not  attained.  Hence  there  exists  a  X'eS  (x')  such  that 

a 

t(x')  <  0(X')  <  t(x'),  and  P^tfx^x'}  >  a.  Thus  by  the  monotonicty 
of  t (x) , 

Px,(t(X)  <  0(X')>  >  Px,{t(X)  <  t (x * ) }  =  PX,(X<  x’}  >  a  .  (2.5) 

This  contradicts  the  hypothesis  that  P^{0(A)  <  t(X)}  _>  1  -  ot  for  all 
X  and  establishes  (ii)  .  To  show  (i)  we  let  t*(x)  =  sup  t(y)  and 
observe  that  t*(x)  is  monotone  in  the  ordering  on  X  and  t*(x)  >_  t(x) 
for  all  x  el.  Hence  if  t(x)  is  a  1  -  a  confidence  bound  for  0(A),  so 
is  t*(x)  and  applying  (ii)  to  t*(x)  yields  (i)  .  Q. 

In  order  to  specialize  these  results  in  the  direction  of 
applications  we  henceforth  assume  that  the  parameter  A  and  the 
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observation  X  are  both  of  dimension  k,  i.e.,  X  =  (X  )  and 

X  Z.  K. 

X  =  » * . .  ,Xj^)  where  the  A^fs  axe  real  and  the  X^Ts  are  random 

variables.  Without  essential  loss  of  generality  we  assume  that  A 
contains  the  positive  orthant.  Within  this  framework  we  make  the 
following  additional  assumptions: 


Assumption  A3.  The  function  0(A)  is  continuous  and  strictly 
increasing  in  each  of  the  A^fs. 

Assumption  A4.  For  any  xe  I,  P^(x^x)  is  continuous  in  each  of  the 

A.  fs. 

1 

Proposition  P4.  Assumptions  A3  and  A4  imply  that  Assumption  A2  is 
satisfied. 


Proof:  Suppose  that  for  some  x'el  there  exists  a  A’eA  such  that 

0(A  )  =  t(x!)  and  P^t{x^  xf}  >  a.  Then  by  A3  and  A4  we  can  find  a 

A"  £  A  with  A  "  A.  1  for  all  i  and  A,  *'  >  A.  "  for  some  i  such  that 
x  —  1  i  i  o 

o  o 

6(X")  >  t(x')  and  P^„{x-^x'}  >  a.  This  contradicts  D2  and  the 
result  follows .  Q 


Corollary  Cl.  If  (i)  the  observations  X^,X  #X.  are  independent 
Poisson  random  variables  with  parameters  X_ ,X„, . , . ,X,  respectively, 

X  m 

and  (ii)  0(X)  =  a^X.^  a2^2  "*’•••"*’  s^X^  where  the  a^'s  are  positive, 
then  t(x)  given  by  D2  is  an  upper  confidence  bound  for  9(X)  at  level 
1  -  a. 
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Proof:  A1  is  satisfied  for  any  ordering  since  X  is  discrete.  A3  is 
clearly  satisfied  for  0(X)  of  the  form  given  by  (ii) ,  and  A4  is 
satisfied  for  Poisson  random  variables.  The  desired  result  follows 
from  P4  and  P2.  JJ 

The  actual  computation  of  the  bound  t(x)  given  by  D2  is 
greatly  facilitated  if  P^{x^  x)  is  monotone  in  the  components  of  X. 
The  following  proposition  gives  conditions  guaranteeing  this 
property: 

Assumption  A5.  The  components  of  X  are  independent  and  for 
i  =  1>  2, . . .  ,k  the  distribution  of  each  X^  depends  only  on  the 
corresponding  X_^  and  is  stochastically  increasing  in  X.. 

Definition  D3.  We  denote  by  (  )  the  natural  partial  ordering  of  X 

generated  by  componentwise  dominance.  That  is,  x^y  if  and  only  if 

* 

X±  £  y±  for  i  58 1,2, . . .  ,k,  with  x<y  if  at  least  one  of  these 

inequalities  is  strict.  An  arbitrary  total  ordering  on  X  is 

,  *  * 

consistent  with  (  ^  )  if  y  implies  x^  y. 

Proposition  P5.  If  the  ordering  on  X  is  consistent  with  the  natural 
partial  ordering  and  Assumption  A5  is  satisfied,  then  for 
each  x  e  X,  P^{x^x}  is  non- increasing  in  each  component  of  A. 

Proof :  For  ycX  we  introduce  the  representation  y  =  (y  where 

(2)  ✓  x 

y  “  ^2*^3* #  *?or  rea^  z>  fixed  xeX,  and  all  yeX,  let 

Ix(z>y^  ^ )  be  the  indicator  function  of  the  set  {y^^  :  (z,y^^)^  x)  . 
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Then 


PjX^x}  =  E,  I  (X,,X^2))  .  (2.6) 

A  A  x  1 

For  any  y  £  X,  if  z'  <_  z",  then  (z',y^)  (z",y^2^),  by  the  con- 

(2)  (2) 

sistency  hypothesis,  and  I  (z',y  )  _>  I  (z",y  ).  Hence  letting 

X  X 

/n\ 

G  (z)  =  E. (l  (X  ,X  )[X-  =  z}  we  see  that  G  (z)  is  non-increasing  in 
z.  Thus,  since  the  distribution  of  X^  is  stochastically  increasing 
in  A1  (A5) ,  we  conclude  that  Ex  I^X^X^)  =  G^X.^  is  non¬ 

increasing  in  A^,  The  same  argument  applies  to  the  other  components 
of  A  establishing  the  desired  result.  Q 

Suppose  that  A  is  the  non-negative  orthant  of  and  let  § 

be  the  simplex  §  =  {A  :  E^=1  Ai=l}.  If  A4  and  A5  are  satisfied,  then 
by  P5  we  observe  that  for  any  A  £  §  and  real  c,  Pc^{x<.x>  is  continu¬ 
ous  and  non- increasing  in  c.  If  the  lower  bound  of  P  ,{x^.xl  as 
C  •*  00  is  less  than  a  for  all  x  e  X  and  all  A  e  §,  then  for  each  x  e  X 
and  A  £  §  there  exists  a  smallest  number  b  =  b(x,A)  such  that 

P b(x,A) A^X  ^  =  a*  The  confidence  bound  t(x)  defined  by  D2  is  then 

given  by 

t(x)  -  sup  9(b(x,A)A)  .  (2.7) 

A£§ 

Now  b(x,A)  is  easily  computed  using  root-finding  techniques  so  that 
the  computation  of  t(x)  reduces  to  searching  over  §  for  the  maximum 
of  9(b(x,A)A).  Many  routines  are  available  for  implementing  such 
searches.  For  the  situation  described  in  Corollary  Cl,  the  value  of 
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b  such  that  Pb^{x<.  x}  =  a  is  unique  and  (2.7)  is  a  computationally 
feasible  version  of  (1.5). 

All  of  the  above  results  apply  mutatis  mutandis  to  the  con¬ 
struction  of  lower  confidence  bounds  and  hence  confidence  intervals. 
Applications  to  the  reliability  of  coherent  systems  involving  the 
binomial  or  other  distributions  are  possible.  In  particular,  the 
above  discussion  applies  directly  to  the  binomial  case  under  the 
transformation  A±  =  -  logU-p^,  i  =  l,2,...,k; 

eu>  -  x.  .  -  log  n*=1  u-Pi). 

3.  Systems  With  k  =  2 

As  was  noted  in  Section  1,  if  the  system  has  effectively  only 
one  component  (e.g.,  when  all  sample  sizes  are  equal),  then  the  pro¬ 
blem  reduces  to  the  well-known  case  of  finding  an  upper  confidence 
bound  for  a  single  Poisson  parameter.  Then  in  the  notation  of 
Section  1,  6(A)  =  A  and  if  t(x)  is  the  confidence  bound  for  A,  the 
lower  confidence  bound  (1.6)  for  reliability  R  becomes 

r(x)  =  1  -  t(x)/n  ,  (3.1) 

where  n  is  the  (common)  sample  size. 

The  two  component  case  (k  =  2)  presents  all  of  the  difficul¬ 
ties  of  the  general  case.  The  principal  problem  is  to  generate  an 
ordering  of  the  sample  points  x  =  (x^x^  which  will  lead  to  a  "good" 
confidence  bound  t(x)  computed  using  (1.5)  or  (2.7).  Several  differ¬ 
ent  methods  have  been  considered  and  implemented  to  varying  extents 
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the  course  of  this  investigation.  These  methods  may  be  described 
briefly  as  follows: 

(i)  The  x’s  are  ordered  according  to  the  values  of  the  func¬ 
tion  t(x)  =  a^x.^  +  a2^2  Za!^alXl  a2x2  *  w^ere  is  the 
upper  a-th  quantile  of  the  standard  normal  distribution, 

(ii)  The  x’s  are  ordered  according  to  the  values  of  the  approx¬ 
imate  confidence  bound  obtained  from  the  maximum  likeli¬ 
hood  ratio  statistic  (see  Section  4) . 

(iii)  The  ordering  is  generated  sequentially  by  considering  at 
each  stage  the  group  of  points  which  are  not  yet  ordered 
but  could  be  adjoined  without  violating  the  natural  par¬ 
tial  ordering  (see  D3  of  Section  2) .  The  next  point  in 
the  ordering  is  then  chosen  to  be  the  "best"  member  of  the 
candidate  group,  i.e.,  the  point  producing  the  smallest 
value  of  t (x)  given  by  (1.5). 

(iv)  The  ordering  is  chosen  so  as  to  minimize  E  (t(X)}  for  some 

G 

suitable  prior  distribution  G  over  tbe  values  of  \m 

(v)  The  ordering  is  generated  sequentially  in  the  manner  of 

(iii)  above  except  that  at  each  stage  the  candidate  points 
for  the  next  two  steps  are  considered  as  pairs  and  the 
next  point  selected  is  the  first  step  component  which, 
together  with  the  best  available  point  for  the  second 
step,  produces  the  smallest  sum  for  the  two  values  of 
t(x).  Note  that  the  point  that  appears  to  be  "best"  two 

steps  ahead  may  not  actually  be  chosen  when  that  stage  is 
reached. 
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It  is  clear  that  none  of  these  methods  is  special  to  the 
case  k  —  2.  Method  (i),  based  on  the  function  t(x)  ,  which  is  really 
a  maximum  likelihood  estimate  of  an  asymptotically  valid  confidence 
bound,  was  used  to  generate  tables  of  bounds  for  the  case  k  =  2  in 
Johns  (1975).  Method  (ii)  does  not  improve  substantially  on 
Method  (i)  for  moderate  values  of  the  X^fs.  Methods  (i)  and  (ii)  are 
asymptotically  equivalent  when  at  least  one  becomes  large  (see 
Johns  1975)  and  indeed  standard  maximum  likelihood  results  guarantee 
that  both  are  asymptotically  optimal.  Method  (iii)  discussed  in 
Johns  (1977)  was  found  to  be  a  substantial  improvement  on  (i)  in  the 
strong  sense  that  when  the  Method  (iii)  ordering  is  used  the  values 
of  t(x)  are  often  smaller  and  only  rarely  slightly  larger  than  the 
values  for  corresponding  x's  produced  by  Method  (i) . 

The  semi-Bayes ian  approach  of  Method  (iv) ,  which  minimizes 
the  expected  length  of  the  confidence  interval,  is  the  only  one  of 
the  five  that  is  directly  motivated  by  optimality  considerations. 

The  bound  resulting  from  any  reasonable  prior  must  at  least  be 
admissible.  In  pursuing  this  approach  it  was  decided  in  the  spirit 
of  objectivity  and  in  the  hope  of  rapid  convergence  to  asymptotic 
optimality  to  choose  a  prior  distribution  leading  to  an  unconditional 
probability  mass  function  for  xx  and  x2  constant  for  constant  values 
of  the  maximum  likelihood  estimator  a^x^  +  a2x2  for  0(A).  In 
particular,  the  prior  density  for  A^  and  A2  was  taken  to  be 


This  produces  the 


-3a-  -3a 

where  b^  =  (1-e  ) ,  =  (1-e  Z)  ,  3  >  0. 

unconditional  probability  mass  function 

-3(a1x1  +a2x2) 

p (x.^ , x^)  ~  h^b^  ^  9  5 X2  ”  •  *  * »  •  (3* 3) 

In  the  limiting  case,  as  3  "*  0,  p(x^,x^)  becomes  essentially  uniform 
over  any  finite  set  of  points  (x^x^)  . 

The  actual  minimization  of  E  (t (X) }  may,  in  principle,  be 
accomplished  by  finding  the  ordering  which  minimizes  the  contribution 
to  E^  among  all  orderings  of  length  N  where  N  may  be  arbitrarily 
large.  This  may  be  done  systematically  by  starting  at  the  origin 
(0,0)  and  constructing  a  tree  whose  nodes  at  each  stage  are  charac¬ 
terized  by  a  candidate  point  newly  adjoined  to  the  ordering  and  the 
corresponding  value  of  £p(x)t(x),  where  the  sum  is  taken  over  all  xfs 
occurring  in  the  path  leading  to  the  node,  including  the  one  just 
adjoined.  At  the  N-th  stage  the  node  having  the  smallest  accumulated 
sum  identifies  the  optimal  ordering  of  length  N.  This  process  may  be 
facilitated  by  eliminating  duplicate  nodes  and  discontinuing  branches 
when  a  node  is  reached  whose  value  exceeds  that  known  to  be  attain¬ 
able  in  N  stages.  Nevertheless,  because  of  the  rapid  increase  in  the 
number  of  nodes  considered  per  stage,  only  the  first  forty  or  so 
points  in  the  optimal  orderings  could  be  determined  even  using  a  very 
large  computer  facility. 

In  order  to  obtain  examples  of  admissible  orderings  with 
which  to  compare  the  results  of  other  methods,  this  computation  was 
performed  for  two  cases  using  an  IBM  370/168.  For  both  cases  the 
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values  a  =  .10  and  a^  =  .30  were  used.  For  the  first  case  the  proba¬ 
bilities  given  in  (3.3)  with  3=1  were  used  and  the  first  41  points 
of  the  optimal  ordering  were  obtained.  The  forty-first  stage  of  the 
computation  produced  4557  nodes.  For  the  second  case  the  limiting 
situation  as  3  -*■  0  where  the  p(x)'s  are  all  equal  was  used  and  the 
first  43  points  of  the  optimal  ordering  were  obtained.  The  number  of 
nodes  produced  at  the  forty-third  stage  was  6478. 

A  comparison  of  these  results  with  the  corresponding  results 
obtained  using  Methods  (i),  (iii),  and  (v)  is  indicated  in  Figure  1. 
The  horizontal  axis  indexes  the  first  50  points  in  the  ordering  pro¬ 
duced  by  Method  (v) ,  the  two-step  prospective  sequential  procedure. 
The  values  of  t(x)  for  these  indexed  points  for  the  five  methods  are 
indicated  by  the  plotted  symbols.  Values  of  t(x)  for  methods  other 
than  (v)  are  shown  only  when  they  differ  from  those  produced  by  that 
method.  Based  on  this  evidence  it  appears  that  Method  (iv)  and 
Method  (v)  differ  very  little  and  that  both  are  better  than  the  other 
methods.  In  fact.  Method  (iv)  for  the  uniform  case  (3  =  0)  differs 
only  trivially  from  Method  (v) .  Since  the  use  of  Method  (iv)  for  the 
construction  of  tables  is  now  and  probably  always  will  be  impractical, 
we  are  led  to  the  choice  for  this  purpose  of  the  more  tractible  and 
virtually  equivalent  Method  (v) .  Prospective  sequential  methods 
looking  ahead  more  than  two  steps  might  be  feasible,  although  the 
complexity  of  the  computations  increases  rapidly  with  the  number  of 
steps.  However,  such  procedures  would  be  expected  to  produce  only 
minute  improvement  over  the  two-step  method. 
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Figure  1 .  Comparison  of  confidence  bounds  for  five  ordering  methods: 


Table  1  gives  values  of  the  upper  confidence  bound  t(x)  com¬ 
puted  using  (2.7)  with  the  sample  orderings  generated  by  the  two-step 
prospective  sequential  Method  (v) ,  The  values  are  given  for  the 
first  100  points  in  each  ordering  for  a  =  .01,  .05,  .10,  for 
a1  =  .05(.05).45.  It  is  assumed  that  the  components  of  the  system 
are  indexed  so  that  a;L  <  a2  which  implies  ^  <  .50.  For  convenience 
the  values  of  (x^,x^)  are  listed  systematically  rather  than  in  the 
order  generated  by  the  two-step  procedure.  This  table  provides  a 
basis  for  computing  accurate  confidence  bounds  for  the  case  k  =  2 
using  only  simple  interpolation.  If  values  of  a^^  greater  than  .45 
but  (necessarily)  less  than  .50  are  required,  the  bound  for  a1  =  .5 
(corresponding  to  =  n2)  may  be  used  for  interpolation.  This  bound 
is  obtained  by  simply  multiplying  the  ordinary  upper  confidence  bound 
for  a  single  Poisson  parameter  based  on  x  =  +  x2  failures  by  .50 

(see,  e.g.,  Pearson  and  Hartley  1958  for  tables).  The  use  of  Table  1 
is  illustrated  by  the  following  two  examples: 

Example  1 .  Suppose  that  the  two  components  of  a  series  system  are 
tested  independently  using  sample  sizes  n.  =  300  and  n  «  100 
respectively  with  the  corresponding  observed  numbers  of  failures 
x!  =  3  and  X2  =  4.  Then  c  =  (1/300  +  1/100)  =  4/300  and 
aj_  ~  l/cn^  =  *25  =  1  -  a2»  If  we  wish  to  find  a  95  percent  confi¬ 
dence  interval,  we  take  a  =  .05,  and  from  Table  1  we  find  the  confi¬ 
dence  bound  t(x)  for  6(X)  to  be  7.333.  Hence  by  (1.6)  the  95  percent 
lower  confidence  bound  for  system  reliability  R  is 
1  -  (4/300) (7.333)  =  .902. 
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Table  1.  The  Confidence  Bound  t(x)  for  k  =  2  for  the  First  100  Points  Generated  by  the 
Two-Stage  Optimal  Ordering  Method  for  Each  a.  and  a. 
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Table  1.  (Continued) 
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Table  1.  (Continued) 


i 

I  cj 
I  X 
I  - 

I  X 
I  ~ 


II 

N  1 
X  1 
i 

—  CJ 

tA 

It 

X 

a 

•?  i 
X  1 

1 

O'  O' 

O' 

I  X 

I  X 

I  ■*-* 

I 

I 

I  CJ 

i  X 
l 


t  cj 
I  X 


tl  l 

1 

a  i 

i: 

r-*  | 

«  I 

I 


I 

I  — 

I  X 


a  i  — 
— »  i  x 


w-ooC'OWo>£)-i/i^^^iri-Noij,)^o<f^i^^oinfoC'C'NO'row(>co«6Ki<ocoo'^^OK)in»-Nfoa^ 
^•-CNifOCOWrO^OKI^lfi  —  *JNOfOl/l(Ofs»^s£)^lOK)ONl<»*-CO<fK>Oiri<t-  —  «ONfN<0(>00  —  W«J-lTtN(0O 
uih'co^r^o^ovoo  —  cucocsiro^o<j-iA'£)fo<tr^<rcoi>r*.o»-a'Cjro  —  uninror^irja'r^.-~o<rcj>D<rvOcoocju^ 

'tf*iA'0iA.tf,iAfvrAiA'OfvrAiA'OiV'3’iA'Of,'‘'3-iA'O'^iA'O'<!’''©fV'O'orviA'AfviA'OiA'OiAf''iAi'''OfV'O'O'Oiviviv 

^&lrtO*-WMO**(Jr0O»-WMO^WnO»*WO*-WO**WO»-WO^WO^O**O**Oi-O**OOOOOO 


^  —  «-CJCJCJCJCJOJCJCJCJCJCJCJCJCJ 

t'JCj<0lAlAOftJW(0lfltAO^*-<0’0'0*-K>ON«O<0^,'0C5^O«^O*-^^<0M^0,'C0<0W«0^WWlA«f)0‘WN»t 

^*-W<fO'CaN<^(ONWIflNlflO‘COKl«OCJO*^K((£)*-©«0*»*-<OOlft0^lAit»tO'^(\lllO>fO'OCJNlftO*»WN 

<0*-WKlM4,<0*-Nrt'tf,'t^aK)4,ifllfl»»r0Lft'0^)f'NlrtN(0<0'i’N0'0'O'0^O**W<0**ftl^4,OnLft^)^W 

•-rA-oiA'Ofv  —  »A*3,iA'Orv*-rA'<fiA'or*'CjrA.tf>iA'0f''<jrA.tf'iA'OcjrA<riArvcjrAiA'Orvcj*3'iA'OivrA.tf'iAj>ivrA 
O**NM^lftO*-WK>'tlflO»-Nr0^JAO^ftjr0<flAO*-Wrt^O*-WW^O*-Wr04-O*-WM4'O*-CJK)^O 
oooooo»-*-*-*“^»-wwwwcjw^rnroronio^^>f^<jir)iflini/iLnO'6^)'O^NNNNNcOcOco<ocoo 


N  M  «  <r  1/1  lA  o 

lA 

lA 

CO 

«u  -A  *0 

o 

<r 

CJ 

o 

rv 

CO 

CJ 

o 

*A 

»v 

rA 

ro 

ro 

rv 

^p. 

O' 

<r 

'O  o 

Jl 

CJ 

(0  lA  O  <0  O'  <A  M 

O' 

O 

IA 

m  ©  — 

CJ 

iv 

rA 

IA 

co 

IA 

rv 

o 

O 

CO 

CJ 

co 

O' 

<J- 

O' 

o 

rA 

O' 

<r 

-  «0  ^  O  KHO  - 

CJ 

>o 

rA  ia  co 

rA 

IA 

o 

IA 

rv 

CJ 

IV 

O' 

iA 

O' 

A- 

rA 

O' 

IA 

'O 

IA  co 

IA 

o 

5 

r^t^Lft^r-^iri>ocONriri^cOsr<)r^cONj'>C'rs*Lri^)r«.iA>or-iri<)coiAr^<3Dirir^vor>.>Dr^sc>co^cof^<or^r-r-is-co<o 

rto*-wrto*-ftjroo^wrto^cyJrto**ftio»*fcio-No^wo^wo**o^Of0^o*'0»*oooooo 

(>OOOO«-»**-*-WCylC4ftir0r<1Klrt^4,-!MflUUft^OONNN<0O£00*^OO***-WNKlrt<fvtlA'0NC0^O 


MftNrtK)ONlANMr0^^^Or0^NN-l/)M^O<0^<fM^O»-Olfia)OO<hCyj^W^<M/l0‘0'CM>oO»t 

^^Mow-^w^nir>'trofON<f^ifts<owO'*-^tfO'oco*-KioinNO'«tO'«tN<oir)^<rNrs-0'tNKiN 

rtNOWP0*t4,C0OWI0^lft^-l<»4,lA10oM'f<M0W<r^NO^4)<0^»-'C<0O*-|0(0O{vlrtiflOfJ^NWst 

cjrAiA''0{v<ocjrAiA'orvcocjrALA'Orvcocj<4’iA'Or«»cj'3’iA'Or'<'rA>3-iA'OrvrA>3'iAr''COrA>?j»rvcorAiA'Or'*rAiAj) 

O-CMK1^lftO*-WM<tlftO»-WKl^lAO«-<VJKI^O*-CJK»^O*-Wrt<tf,O-Wf0^O--WM^O^Wl0O-*W 

OOOOOO**-*--->*-WWtsJftJWftir0Kir0Klrt^<J’<r^^U1lAlf)lftin<0'0'C'6'fiNNNNN<0«0«0<0^Ch0' 


rv  ^  o> 

rA 

o 

co  O  — 

LA  IA  IA  <0 

O  s£> 

IA  JD 

C0'3-CJCJCJO'sO*-LA'O  — 

O  sA  O  O 

O' 

IV 

O 

rv 

o 

<0  J> 

O' 

rA 

© 

CJ 

rA  ia 

JD 

CJ 

ia  <r 

r>*  —  so 

IA 

o* 

n  n  co 

©  IA  CO  O' 

CJ  O' 

^  rA 

OrAlA<JlA'0A*f^<T’0'0' 

^  h» 

rA 

CJ 

IA 

<t 

rv 

J> 

O'  co 

o 

<t 

CO 

©  CJ 

'T 

o 

cj  <T 

rA  iv 

•“ 

IA 

O'  o  rA 

CO  —  co  LA 

o  o 

CO  CJ 

Kio^incj>oN-tcO(ro 

O  CJ  O'  CJ 

<p- 

o 

rA 

co 

IA 

©  CO 

rA 

*- 

IA 

IV 

O' 

CJ  <f 

J> 

co 

O  CJ 

co  O'  in  iv 

(OCTlANcOOtAN 

O'  «o 

rv  o 

•OCOO'OCOO*«ACOO'J>CO 

©  IV  <0  © 

|V 

o> 

rv 

O 

IV 

o 

CO  O^ 

CO 

10. 

<0 

<0 

CO 

o  o 

O'  O'  ©  © 

cj  rA  © 

- 

CJ 

rA  ©  — 

cj  rA  o  — 

CJ  © 

—  CJ 

©  —  CJ  ©  —  CJ©  —  CJ  O  — 

CJ  ©  •—  CJ 

o 

- 

© 

© 

- 

©  - 

© 

- 

o 

o 

o 

o  o 

o 

o 

o  o 

©  ©  — 

•• 

—  CJ  c  J 

cjcjrArArA«tf'<r^iAiAiA'O'O'Or^Krs.<oc0c0O'O'O' 

© 

© 

CJ 

CJ 

rA  rA 

<* 

IA 

'O 

rv 

«0  O' 

o 

cj  rA 

«r  ^ 

CJ 

CJ 

CJ 

CJ 

CJ 

CJ 

CJ  CJ 

CJ 

CJ 

CJ 

CJ 

CJ 

CJ  CJ 

IA 

rA 

rA  rA 

£*-iA'©'fr'fr"-iArv,a'*-o*'fr>0'3’iAiA*-'3’tA«o  —  O'<r&cjO'~<o*otf>O'*j*jco<tcbotfisDr^r*&ifi4‘0'*-o<ro 

<o»-cjfoco  —  »tiri>o-w>d,vONwoa'^wNw»orsO'<j,ovtsoNcjcofJinN  —  Nroi^f'.^-vj5inm<0'0w«ooo<r 

OK>rsONNK)fsOM<0^<0*-<3‘0'WOr0lA*-N^^Nrt0‘r0-4)^<J,*-W(0*-^r0NOr0<0in0'NOh*-UjCyJ0‘ 

rAiA'Acoo'rAiA'Acoo'rAiA  o  co  0'rAiAr'*<oo'*3-LAfvcoo<rLArvcoO'<i'-Arv<o©'j''AC'*o©<}'soivo'iA'Acc>0'iA'A 

O-Wr0sJ‘O»-WK)>JO*“Wr0<fO^Wf0>J'O*“WK)'J,O*-fJKl<ro-WKl>tO-WKl<fO^NJ0O^WKlO- 

OOOOO  —  -.*--^W(jW(MWK)K>r0fnK)^4-'J't'tlftLT|^l/Hf»OsD'0'0>DNNNrsN£0<0<0<00'^(M>OO 


25 
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9.089 


A  somewhat  more  complicated  case  making  use  of  the  possibil¬ 
ity  of  combining  component  data  when  some  sample  sizes  are  equal,  as 
described  in  Section  1,  is  illustrated  by 


Example  2.  Consider  a  five-component  series  system  with  test  data 
Xx  =  0,  X2  =  4,  Xg  =  2,  X4  =  1,  X4  =  3,  based  on  corresponding  sam¬ 
ple  sizes  =  n2  =  n^  =  300,  n4  =  n5  =  200.  Here 
c  =  (3/300  +  2/200)  =  .02,  ^  =  a2  =  a3  -  l/300(.02)  =  1.6, 
a4  =  a,.  =  l/200(.02)  =  1/4.  For  the  equivalent  k*  =  2  problem  we 

divide  the  two  distinct  values  of  the  a  's  by  their  sum  c  =  1/6  + 

i  o 

1/4  =  5/12,  obtaining  a*  =  .40,  a*  =  .60.  The  corresponding  numbers 
of  failures  are  x£  =  X1  +  X2  +  X3  =  6  and  X*  =  X4  +  X5  =  4.  For  the 
reduced  problem  we  consult  Table  1  for  a  =  .10  to  find  the  90  per¬ 
cent  confidence  bound  7.564.  This  must  be  multiplied  by  c  to 
obtain  the  bound  for  the  original  0(X).  The  90  percent  lower  bound 
r(x)  for  the  system  reliability  given  by  (1.6)  thus  becomes 
1  -  ccQt(x)  =  1  -  (.02) (5/12) (7.564)  =  .937. 

If  the  observed  numbers  of  failures  fall  outside  the  limits 
of  Table  1,  the  approximate  methods  discussed  in  the  next  section 
may  be  employed. 
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4 .  Approximations 

In  this  section  approximate  confidence  bounds  for  systems 
with  more  than  two  components  having  distinct  sample  sizes  are 
developed.  The  use  of  the  maximum  likelihood  ratio  confidence  bound 
for  cases  falling  outside  the  scope  of  Table  1  is  also  discussed. 

For  k  >  2  it  is  impractical  to  generate  the  optimal  ordering 
and  the  corresponding  values  of  the  upper  confidence  bound  for  more 
than  a  few  illustrative  cases.  Thus,  some  method  of  approximating 
solutions  for  k  >  2  with  acceptable  precision  is  required.  The 
approach  to  be  followed  here  is  to  find  a  k  =  2  problem  which  is  suf¬ 
ficiently  similar  in  structure  to  the  given  k  >  2  problem  so  that  the 
confidence  bounds  for  the  two  problems  are  essentially  the  same  except 
for  a  normalizing  factor.  This  method  may  be  thought  of  as  an  exten¬ 
sion  and  refinement  of  the  Lindstrom-Madden  procedure  (see  Lloyd  and 
Lipow  1977,  and  cf .  Harris  and  Soms  1980). 

The  Lindstrom-Madden  method  first  estimates  the  reliability 
by  maximum  likelihood  and  then  uses  the  k  =>  1  confidence  bound  solu¬ 
tion  for  the  component  with  the  smallest  sample  size  and  a  fictitious 
number  of  failures  determined  so  as  to  reproduce  the  estimated  system 
reliability.  The  procedure  proposed  here  is  to  estimate  two 
quantities,  the  value  of  0  and  the  variance  of  the  maximum  likelihood 
estimate  of  0,  and  to  use  these  estimates  to  find  a  k  »  2  problem 
based  on  two  of  the  original  a^'s  with  a  pair  of  corresponding  ficti¬ 
tious  observation  values  chosen  to  reproduce  the  estimated  quantities . 
The  two  a^'s  are  chosen  to  be  as  large  as  possible  (corresponding  to 
sample  sizes  as  small  as  possible)  subject  to  two  constraints.  The 
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first  constraint  guarantees  that*  the  resulting  fictitious  observations 
are  non-negative.  The  second  constraint  requires  that  a^’s  corre¬ 
sponding  to  zero  failures  in  the  original  problem  not  be  considered 
unless  all  but  one  of  the  components  have  zero  failures .  These  con¬ 
siderations  lead  to  a  unique  k  =  2  problem  whose  solution  provides  a 
very  good  approximation  to  the  solution  for  the  original  k>  2  problem. 

The  elimination  of  a^f s  for  components  exhibiting  zero 
failures  is  justified  by  the  fact  that  the  maximum  likelihood  ratio 
confidence  bound  (discussed  later)  is  invariant  under  such  transfor¬ 
mations.  That  is,  if  the  dimension  k  is  reduced  by  the  elimination 
of  all  a^fs  corresponding  to  zero  failures,  then  the  value  of  the 
maximum  likelihood  ratio  bound  remains  unchanged. 

The  choice  of  the  two  quantities  whose  estimates  are  used  to 

determine  the  pair  of  fictitious  observations  is  supported  by  analogy 

with  Lindstrom-Madden  (in  the  case  of  0)  and  by  the  fact  that  the  two 

estimates  are  the  ingredients  of  the  asymptotic  maximum  likelihood 

ratio  confidence  bound  thereby  insuring  asymptotic  optimality.  The 

details  of  the  approximation  algorithm  are  as  follows: 

k 

(a)  First  0(X)  =  E.  ,  a.X.  is  estimated  by 

i=l  ii 

k 

6  =  E  a.X.  ,  (4.1) 

i=l  1  1 

a  k  2 

and  the  quantity  Var(0)  =  E a^X^  is  estimated  by 

a  k  9 

v  =  E  a2.X.  .  (4.2) 

i  i 
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(b)  Next  if  at  least  one  component  exhibits  one  or  more  failures, 
the  pair  (a^a.),  i  <  j,  is  selected  so  that 

(i)  a^  ;<  v/0  ,  and 


(ii)  a^  v/0 

Subject  to  these  conditions,  a^  and  a^  are  taken  to  be  the 
largest  available  values  associated  with  at  least  one 
failure.  If  all  a^’s  satisfying  (i)  correspond  to  zero 
failures,  then  a^  is  taken  to  be  the  largest  in  that  group. 
If  all  the  a^ 's  satisfying  (ii)  correspond  to  zero  failures, 
then  a^  is  taken  to  be  a^.  If  all  components  exhibit  zero 
failures,  v/0  is  indeterminate  and  a^  and  a_.  are  taken  to  be 
a^  and  a^  respectively.1 

(c)  The  pseudo-observations  x*  and  x*  are  computed  by  the 
formulae 


a  .0  - 

.*  _  3 _ 

1  a. (a.  - 
i  J 


5 


v-  a.0 

l 


WP 


(4.3) 


These  values  will  be  non-negative  by  conditions  (i)  and  (ii) 
of  (b) ,  and  when  associated  with  a^  and  a_.  respectively  they 


1For  this  case  the  resulting  confidence  bound  is  exact  and  is  the 
same  as  would  be  obtained  by  multiplying  a^  times  the  upper  confi¬ 
dence  bound  for  a  single  Poisson  parameter  when  zero  failures  are 
observed,  i.e.,  t(0)  =  log  (1/a) . 
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reproduce  the  values  of  0  and  v  provided  all  other  observa¬ 
tions  are  replaced  by  zeros. 

(d)  The  k  =  2  problem  with  x*  and  x*  associated  with 

a*  -  aJ(a^+aS)  and  a*  -  aj/(ai+a^)  respectively  may  now 
be  treated  using  Table  1  to  yield  t(x*,x*).  Since  x*  and  x* 
are  not  necessarily  integers,  it  may  be  necessary  to  inter¬ 
polate  with  respect  to  these  arguments  as  well  as  the  value 
of  a^a*. 

(e)  The  approximate  upper  confidence  bound  t*  for  0  for  the 
original  k  >  2  problem  is  then  given  by 


t*(x)  =  (a^  a^)t(x*,x*) 


(4*4) 


In  order  to  check  the  validity  of  this  approximation 
algorithm,  the  confidence  bounds  for  the  first  24  points  in  the  opti¬ 
mal  (two-stage  prospective)  ordering  were  computed  for  a  typical  k=  3 
case.  These  results  were  obtained  by  a  rather  laborious  method  based 
on  formula  (2.7)  and  involving  repeated  interactive  searches  of  the 
(^1,^2* ^3)  simPlex*  T^ie  approximation  algorithm  was  applied  to  each 
of  these  points  and  the  comparative  results  are  shown  in  Table  2. 

The  values  of  a^,  a ^  and  a^  for  this  example  were  chosen  to  be  of 
roughly  the  same  magnitude  but  not  so  close  that  the  combination  of 
any  two  would  be  indicated. 

To  check  the  algorithm  for  cases  farther  from  the  origin 
several  additional  examples  were  considered  using  a  somewhat  differ¬ 
ent  method  which  avoids  the  necessity  for  sequentially  generating  the 
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Table  2.  The  Performance  of  the  Approximation  Algorithm  for  the 
First  24  Ordered  Points  for  a  Typical  Example  With  k  =  3. 


a  =  .05;  a^  =  .2,  =  ,3,  =  .5 


Two- 

Step  Prospective 
Sequential 

Approximation 

Algorithm 

n 

X1 

X2 

X3 

t(x) 

t*(x) 

Relative 

Error 

i 

0 

0 

0 

1.498 

1.498 

+ 

00.0  % 

2 

1 

0 

0 

1.553 

1.555 

+ 

00.1 

3 

0 

1 

0 

1.656 

1.663 

+ 

00.4 

4 

2 

0 

0 

1.703 

1.705 

+ 

00.2 

5 

1 

1 

0 

1.756 

1.540 

- 

12.3 

6 

2 

1 

0 

1.861 

1.752 

- 

05.9 

7 

3 

0 

0 

1.933 

1.891 

- 

02.1 

8 

0 

2 

0 

1.981 

1.995 

+ 

00.7 

9 

1 

2 

0 

2.085 

2.052 

- 

01.6 

10 

4 

0 

0 

2.088 

2.094 

+ 

00.3 

11 

3 

1 

0 

2.162 

1.991 

- 

07.9 

12 

2 

2 

0 

2.268 

2.208 

- 

02.7 

13 

5 

0 

0 

2.300 

2.309 

+ 

00.4 

14 

0 

3 

0 

2.354 

2.397 

+ 

01.8 

15 

0 

0 

1 

2.372 

2.372 

+ 

00.0 

16 

4 

1 

0 

2.382 

2.291 

- 

03.9 

17 

1 

0 

1 

2.429 

2.431 

+ 

00.1 

18 

1 

3 

0 

2.472 

2.438 

- 

01.4 

19 

5 

1 

0 

2.504 

2.486 

- 

00.7 

20 

0 

1 

1 

2.543 

2.529 

- 

00.5 

21 

6 

0 

0 

2.575 

2.551 

- 

01.0 

22 

2 

0 

1 

2.602 

2.589 

- 

00.8 

23 

2 

3 

0 

2.609 

2.641 

+ 

01.2 

24 

1 

1 

1 

2.660 

2.668 

+ 

00.3 

36 


optimal  ordering  of  the  sample  points •  For  these  examples  the  order¬ 
ing  was  generated  by  the  values  of  the  maximum  likelihood  ratio  con¬ 
fidence  bounds  (see  below)  associated  with  the  sample  points.  Since 
this  ordering  is  asymptotically  optimal  (for  large  X^'s),  it  can  be 
expected  to  produce  good  results  for  sample  points  well  removed  from 
the  origin.  The  values  of  the  confidence  bounds  calculated  using 
(2.7)  and  the  approximations  obtained  by  the  proposed  algorithm  are 
shown  for  these  examples  in  Table  3. 

In  Table  3  the  tendency  of  the  computed  values  of  t(x)  to 
be  slightly  larger  than  the  algorithm  values  may  be  due  to  the  fact 
that  the  ordering  used  to  compute  the  former  is  non-optima! .  Formal 
application  of  the  algorithm  may  occasionally  result  in  the  selection 
of  nearly  equal  values  a^  and  a^  in  step  (b) .  When  this  happens, 
improved  results  may  be  obtained  by  first  reducing  the  dimension  k  by 
combining  the  nearly  equal  a^Ts  and  then  applying  the  algorithm. 

This  method  was  used  for  the  two  cases  in  Table  3  marked  by  (t)  . 

The  algorithm  values  for  all  cases  where  a  =  ( .14,  .16,  .70)  or 
a  =  ( .15, .41, .44)  do  not  differ  substantially  from  the  values  which 
would  be  obtained  by  reducing  to  the  k  =*  2  case  by  combining  the 
nearly  equal  a^fs.  Similarly,  the  values  for  the  cases  where 
a  -  ( .32, .33, .35)  can  be  nearly  reproduced  by  multiplying  the  k  =  1 
bound  by  a  =*  .333. 

The  number  of  sample  points  appearing  in  the  ordering  before 
a  given  level  of  t(x)  is  reached  increases  rapidly  as  k  increases. 
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Table  3.  Several  Examples  Comparing  the  Algorithm  Values  With  the 
Exact  Bounds  Based  on  the  Ordering  Generated  by  the  m£rb. 


a  =  .05 


al  a2  a3 

X1  x2  X3 

Position  in 
Ordering 

t(x) 

Algorithm 
Value  t*(x) 

m£rb 

.20, .30, .50 

2,  2,  1 

50 

3.329 

3.273 

3.070 

5,  0,  2 

100 

4.068 

3.957 

3.798 

6,  6,  0 

200 

4.887 

4.789 

4.708 

9,  1,  3 

400 

5.980 

5.892 

5.795 

.14, .16,  .70 

5,  4,  0 

50 

3.026 

3.084+ 

2.218 

2,10,  0 

100 

3.424 

3.531f 

2.921 

2,  5,  1 

200 

4.407 

4.086 

3.729 

.15, .41, *44 

13,  0,  0 

50 

3.245 

3.223 

2.980 

5,  2,  1 

100 

4.028 

3.860 

3.699 

3,  3,  2 

200 

4.861 

4.738 

4.559 

.32,. 33,. 35 

0,  3,  2 

50 

3.492 

3.518 

3.256 

1,  5,  1 

100 

4.339 

4.332 

4.076 

1,  5,  3 

200 

5.198 

5.234 

4.993 

t 

Reduction  to 

k?=2  case 

by  combining 

and  a2» 
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Hence  for  k  >  2  the  algorithm  may  be  applied  to  sample  points  posi¬ 
tioned  quite  far  along  in  the  ordering  without  requiring  values 
beyond  the  scope  of  Table  1,  as  is  seen  in  the  examples  of  Table  3. 

The  results  detailed  in  Tables  2  and  3  suggest  that  the 
application  of  the  proposed  algorithm  together  with  the  combining  of 
nearly  equal  a^’s  when  indicated  will  nearly  always  produce  confi¬ 
dence  bounds  for  0 (X)  subject  to  relative  errors  not  exceeding  10 
percent  and  often  much  less.  Furthermore,  the  lower  confidence  bound 
for  reliability  r(x)  given  by  (1.6)  will  exhibit  a  much  smaller  rela¬ 
tive  error  since  the  relative  error  in  approximations  for  t(x) 
applies  only  to  the  difference  between  the  lower  bound  and  one;  a 
quantity  which  at  worst  is  of  the  order  of  1/10  in  the  contemplated 
applications . 

In  situations  where  very  large  sample  sizes  are  available,  it 
may  happen  that  the  observed  numbers  of  failures  exceed  the  limits  of 
Table  1  even  though  the  system  reliability  is  high.  For  such  cases 
the  maximum  likelihood  ratio  bound  (miirb)  may  be  used.  This  approxi¬ 
mate  confidence  bound  is  obtained  in  the  usual  way  from  the  maximum 
likelihood  ratio  statistic  for  testing  the  hypothesis  :  0(A)  -  0Q 
versus  all  alternatives.  The  corresponding  one-sided  confidence 
bound  may  be  shown  (see  Johns  1975)  to  be  determined  as  follows:  Let 
y  be  the  positive  real  root  less  than  1/ (largest  a^  for  which  >  0) 
of  the  equation 
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W.5) 


*I,2a  ‘  2  .E,  Xi 

1=1 


a 

_ in. 


1- 


+  log ( 1  —  a^y) 


where  X-^  2a  -*-s  uPPer  100(2a)-th  percentage  point  of  the  chi- 
squared  distribution  with  one  degree  of  freedom.  Then  the  quantity 


t(X)  =  E  a  X  / (1  -  a.y) 
i=l  1  1  1 


(4.6) 


is  the  approximate  upper  1-  a  level  confidence  bound  for  0(A)  .  As 

/\ 

max(A- , A_ , . . . , A  )  °°,  the  m£rb  t(X)  may  be  shown  (see  Johns  1975)  to 

12  n 

be  asymptotically  equivalent  to 


t(x) 


k 

I 

i=l 


a.X.  +  z 
i  i  a 


k 

E 

i=l 


a2.X. 
1  1 


(4.7) 


where  is  the  lOOa-th  percentage  point  of  the  standard  normal 

distribution. 

Neither  of  these  approximate  bounds  is  useful  for  sample 
points  near  the  origin  in  the  usual  orderings,  but  t  given  by  (4.6) 
becomes  sufficiently  precise  for  application  to  sample  points  beyond 
the  scope  of  Table  1.  A  comparison  of  t(x^,X2)  and  the  corresponding 
m£rb  for  the  last  (i.e.,  the  100-th)  points  in  each  of  the  optimal 
orderings  for  the  cases  covered  in  Table  1  is  given  in  Table  4. 
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Table  4.  mArb/tCx^x^  for  the  100-th  Point  in  Each  Ordering 


al 


a 

.05 

.10 

.15 

.20 

.25 

.30 

.35 

.40 

.45 

.01 

.62 

.95 

.97 

.97 

.98 

.97 

.98 

.97 

.99 

.05 

.72 

.88 

.96 

.95 

.98 

.97 

.99 

.95 

.96 

.10 

.89 

.95 

.95 

.96 

.97 

1.00 

.97 

.96 

.98 

These  results  suggest  that  the  m&rb  possesses  satisfactory 
precision  for  sample  points  beyond  those  listed  in  Table  1  for  k  =  2 
whenever  ^  .10.  The  last  column  of  Table  3  giving  the  m£rb  values 
for  the  examples  considered  illustrates  the  fact  that  for  k  >  2  the 
m&rb  tends  to  underestimate  the  correct  value  of  the  bound  for  sample 
points  within  the  range  that  can  be  dealt  with  using  Table  1  and  the 
algorithm . 

Two  potential  sources  of  error  for  the  lower  confidence  bound  on 

system  reliability  remain  to  be  discussed.  They  are  (i)  the  Poisson 

approximation  to  the  binomial  distribution  of  the  observed  failures,  and 

(ii)  the  approximation  for  reliability  given  in  (1.2)  and  reflected  in 

the  formula  (1.6)  for  the  lower  bound  r(x) .  It  is  intuitively  clear  from 

(1*1)  ff.  that  the  "worst  case"  for  the  Poisson  approximation  should 

occur  when  k  =  1;  since  to  match  a  given  k  =  1  level  of  reliability,  say 

1-p,  by  a  k  >  1  case,  we  must  have  p  =  -  p . ,  so  that  the  p.'s  must  be 

i=l  i  *i 

smaller  than  p  which  tends  to  improve  the  Poisson  approximation. 
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For  the  case  k  =  1  the  familiar  upper  confidence  bounds  for  a 
single  Poisson  parameter  apply  and  the  actual  coverage  probabilities  for 
the  proposed  method  (3.1)  can  be  computed  for  any  n  and  p  from  tables  of 
the  binomial  distribution.  The  results  of  several  such  calculations  are 
shown  in  Table  5. 


Table  5.  "Worst  Case"  Analysis  (k=  1) .  Minimum  Coverage  Probabilities 
for  r(x) . 


Reliability 

1  -  O' 

q  =  1  -  p 

.90 

.95 

.99 

.95 

.906 

.954 

.991 

o 

o\ 

• 

.912 

,958 

.992 

o 

00 

* 

.924 

.965 

.995 

.70 

.936 

.972 

.997 

These  values  suggest  that  the  approximations  operate  to  make  the 
proposed  confidence  bounds  slightly  conservative.  It  is  interesting  to 
observe  that  the  minimum  coverage  probabilities  are  not  drastically  dif¬ 
ferent  from  the  nominal  values,  even  for  a  true  reliability  as  low  as 
.70. 
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Equipment  PDP-11/ 34  running  under  a  UNIX  operating  system.  The  produc¬ 
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computation  of  the  upper  bounds  was  an  implementation  of  (2.7);  and  as 
has  been  noted,  the  sample  points  were  ordered  by  the  two-step  prospec¬ 
tive  sequential  method.  The  tabled  results  were  subjected  to  various 
checks  to  insure  that  the  correct  global  maxima  were  found  in  each  case. 

The  computations  involved  in  obtaining  the  one-step  look-ahead 
results  and  the  tree  analysis  associated  with  the  semi-Bayesian  results 
discussed  in  Section  3  were  done  on  an  IBM  370/168  machine  using  Fortran 
programs  developed  by  David  Pasta.  These  programs  compute  the  upper 
bounds  by  a  somewhat  more  complicated  method  used  in  the  earlier  phases 
of  the  study  and  detailed  in  Johns  (1975). 

Thanks  are  also  due  to  Barry  Eynon  who  helped  with  the  develop¬ 
ment  of  Figure  1  and  the  display  of  Table  1,  and  to  Robert  Bell  and 
Keaven  Anderson  for  careful  readings  of  Sections  2. 
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